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METHOD FOR PROVIDING A DESCRIPTION OF A USER'S CURRENT 

POSITION IN A WEB PAGE 

BACKGROUND OF THE INVENTION 

5 

1. Technical Field: 

The present invention relates to computer network 
environments. More specifically, the present invention 
relates to accessing the content of a web page when a 
10 visual display is not available, 

2. Description of Related Art: 

Information on the World Wide Web is typically made 
available by structuring the information into a visual 

15 presentation. Hypertext Markup Language (HTML) is used 
by the web author to define the visual structure. The 
end user is presented with this information by viewing 
the information on a computer display, after the 
information has been rendered into a visual format by a 

20 web browser (e.g. Netscape Navigator or Microsoft 
Internet Explorer) . 

However, the visual presentation of web pages is not 
accessible by people with vision impairments, nor is the 
content accessible by users who do not have a visual 

25 display device available. A variety of software products 
are becoming available which enable non-visual access to 
the HTML pages. These products capture the web page 
content and then present an audible rendering of the web 
page. This is generally accomplished by using a 

30 text-to-speech (TTS) technology to read the textual 
content. 

In a non-visual web browser, the current position of 
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the TTS "cursor" in the document is called the Point of 
Regard (POR) . In the absence of visual queues, however, 
it is often difficult for a user of an audible web 
browser to determine where the POR is within the current 
5 web page. For example, a sighted user viewing a web page 
might page down through a few screens and see that he is 
in the second paragraph following a header. The user can 
also use the visual position of a scroll bar to assess 
the position relative to the entire page. The visually 

10 impaired user (or a sighted user without a visual 

display) , by contrast, may have arrived at the same point 
in the document after pressing the Scroll Down key 
several times, but he will have no idea what section he 
is in. It is easy for such a user to get lost within the 

15 document after he has been navigating within it for some 
time. The visually impaired user might lose track of his 
overall position within a document (top, middle or 
bottom) , as well as what specific section of the document 
he is currently accessing. The user might also have 

20 problems determining what other content is surrounding 
the specific content being directly accessed. 

Prior art in this area involves counting up every 
item in the web page and announcing the POR as an index 
within the total number of items on the page. For 

25 example, M I tern 54 of 206 items". The running time for 
this approach is proportional to the number of items on 
the web page. In addition, the prior art does not 
provide specific description of the page contents. 

Therefore, it would be desirable to have a method 

30 for audible description of a user's position in a web 
page that provides detail concerning web page contents 
and reduces processing time. 
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SUMMARY OF THE INVENTION 

The present invention provides a method, program, 
and apparatus for providing a description of current 
position in an electronic document . The invention first 
comprises parsing the electronic document into a parse 
tree. When the system receives a command from the user 
requesting current position in the electronic document, 
an algorithm performs a walk up the parse tree, from the 
current position to the root of the document. A position 
response, containing nodes in the walk up the parse tree, 
is constructed by the algorithm and reported to the user. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The novel features believed characteristic of the 
5 invention are set forth in the appended claims. The 

invention itself, however, as well as a preferred mode of 
use, further objectives and advantages thereof, will best 
be understood by reference to the following detailed 
description of an illustrative embodiment when read in 
10 conjunction with the accompanying drawings, wherein: 

Figure 1 depicts a pictorial representation of a 
network of data processing systems in which the present 
invention may be implemented; 

Figure 2 depicts a block diagram of a data processing 
15 system that may be implemented as a server in accordance 
with a preferred embodiment of the present invention; 

Figure 3 depicts a block diagram illustrating a data 
processing system in which the present invention may be 
implemented; 

20 Figure 4 depicts a block diagram of a browser 

program in accordance with a preferred embodiment of the 
present invention; 

Figure 5 depicts a flowchart illustrating the 
general steps of the present invention; 

25 Figure 6 depicts a diagram illustrating a HTML parse 

tree in accordance with the present invention; and 
Figure 7 depicts a flowchart illustrating the 
algorithm for constructing an audible position 
identification in accordance with the present invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

With reference now to the figures, Figure 1 depicts a 
5 pictorial representation of a network of data processing 
systems in which the present invention may be implemented* 
Network data processing system 100 is a network of 
computers in which the present invention may be 
implemented. Network data processing system 100 contains 
10 a network 102, which is the medium used to provide 

communications links between various devices and computers 

connected together within network data processing system 

v. 

100. Network 102 may include connections, such as wire, 
wireless communication links, or fiber optic cables. 

15 In the depicted example, a server 104 is connected to 

network 102 along with storage unit 106. In addition, 
clients 108, 110, and 112 also are connected to network 
102. These clients 108, 110, and 112 may be, for example, 
personal computers or network computers. In the depicted 

20 example, server 104 provides data, such as boot files, 
operating system images, and applications to clients 
108-112. Clients 108, 110, and 112 are clients to server 
104. Network data processing system 100 may include 
additional servers, clients, and other devices not shown. 

25 In the depicted example, network data processing 

system 100 is the Internet with network 102 representing a 
worldwide collection of networks and gateways that use the 
TCP/IP suite of protocols to communicate with one another. 
At the heart of the Internet is a backbone of high-speed 

30 data communication lines between major nodes or host 
computers, consisting of thousands of commercial, 
government, educational and other computer systems that 
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route data and messages. Of course, network data 
processing system 100 also may be implemented as a number 
of different types of networks, such as for example, an 
intranet, a local area network (LAN) , or a wide area 
5 network (WAN) . Figure 1 is intended as an example, and not 
as an architectural limitation for the present invention. 

Referring to Figure 2, a block diagram of a data 
processing system that may be implemented as a server, 
such as server 104 in Figure 1, is depicted in accordance 

10 with a preferred embodiment of the present invention. 
Data processing system 200 may be a symmetric 
multiprocessor (SMP) system including a plurality of 
processors 202 and 204 connected to system bus 206. 
Alternatively, a single processor system may be employed. 

15 Also connected to system bus 206 is memory 

controller/cache 208, which provides an interface to local 
memory 209. I/O bus bridge 210 is connected to system bus 
206 and provides an interface to I/O bus 212. Memory 
controller/cache 208 and 1/0 bus bridge 210 may be 

20 integrated as depicted. 

Peripheral component interconnect (PCI) bus bridge 
214 connected to I/O bus 212 provides an interface to PCI 
local bus 216. A number of modems may be connected to PCI 
bus 216. Typical PCI bus implementations will support 

25 four PCI expansion slots or add-in connectors. 

Communications links to network computers 108-112 in 
Figure 1 may be provided through modem 218 and network 
adapter 220 connected to PCI local bus 216 through add-in 
boards . 

30 

Additional PCI bus bridges 222 and 224 provide 
interfaces for additional PCI buses 226 and 228, from 
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which additional modems or network adapters may be 
supported. In this manner, data processing system 200 
allows connections to multiple network computers. A 
memory-mapped graphics adapter 230 and hard disk 232 may 
5 also be connected to I/O bus 212 as depicted, either 
directly or indirectly. 

Those of ordinary skill in the art will appreciate 
that the hardware depicted in Figure 2 may vary. For 
example, other peripheral devices, such as optical disk 

10 drives and the like, also may be used in addition to or in 
place of the hardware depicted. The depicted example is 
not meant to imply architectural limitations with respect 
to the present invention. 

The data processing system depicted in Figure 2 may 

15 be, for example, an IBM RISC/System 6000 system, a product 
of International Business Machines Corporation in Armonk, 
New York, running the Advanced Interactive Executive (AIX) 
operating system. 

With reference now to Figure 3, a block diagram 

20 illustrating a data processing system is depicted in which 
the present invention may be implemented. Data processing 
system 300 is an example of a client computer. Data 
processing system 300 employs a peripheral component 
interconnect (PCI) local bus architecture. Although the 

25 depicted example employs a PCI bus, other bus 

architectures such as Accelerated Graphics Port (AGP) and 
Industry Standard Architecture (ISA) may be used. 
Processor 302 and main memory 304 are connected to PCI 
local bus 306 through PCI bridge 308. PCI bridge 308 also 

30 may include an integrated memory controller and cache 

memory for processor 302. Additional connections to PCI 
local bus 306 may be made through direct component 
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interconnection or through add-in boards. In the depicted 
example, local area network (LAN) adapter 310, SCSI host 
bus adapter 312, and expansion bus interface 314 are 
connected to PCI local bus 306 by direct component 
5 connection. In contrast, audio adapter 316, graphics 

adapter 318, and audio/video adapter 319 are connected to 
PCI local bus 306 by add-in boards inserted into expansion 
slots. Expansion bus interface 314 provides a connection 
for a keyboard and mouse adapter 320, modem 322, and 

10 additional memory 324. Small computer system interface 

(SCSI) host bus adapter 312 provides a connection for hard 
disk drive 326, tape drive 328, and CD-ROM drive 330. 
Typical PCI local bus implementations will support three 
or four PCI expansion slots or add-in connectors. 

15 An operating system runs on processor 302 and is used 

to coordinate and provide control of various components 
within data processing system 300 in Figure 3. The 
operating system may be a commercially available operating 
system, such as Windows 2000, which is available from 

20 Microsoft Corporation. An object oriented programming 
system such as Java may run in conjunction with the 
operating system and provide calls to the operating system 
from Java programs or applications executing on data 
processing system 300. "Java" is a trademark of Sun 

25 Microsystems, Inc. Instructions for the operating system, 
the object-oriented operating system, and applications or 
programs are located on storage devices, such as hard disk 
drive 326, and may be loaded into main memory 304 for 
execution by processor 302. 

30 Those of ordinary skill in the art will appreciate 

that the hardware in Figure 3 may vary depending on the 
implementation. Other internal hardware or peripheral 
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devices, such as flash ROM (or equivalent nonvolatile 
memory) or optical disk drives and the like, may be used 
in addition to or in place of the hardware depicted in 
Figure 3. Also, the processes of the present invention 
5 may be applied to a multiprocessor data processing 
system. 

As another example, data processing system 300 may 
be a stand-alone system configured to be bootable without 
relying on some type of network communication interface, 

10 whether or not data processing system 300 comprises some 
type of network communication interface. As a further 
example, data processing system 300 may be a Personal 
Digital Assistant (PDA) device, which is configured with 
ROM and/or flash ROM in order to provide non-volatile 

15 memory for storing operating system files and/or 
user-generated data. 

The depicted example in Figure 3 and above-described 
examples are not meant to imply architectural 
limitations. For example, data processing system 300 

20 also may be a notebook computer or hand held computer in 
addition to taking the form of a PDA. Data processing 
system 300 also may be a kiosk or a Web appliance. 

Turning next to Figure 4, a block diagram of a 
browser program is depicted in accordance with a 

25 preferred embodiment of the present invention. Browser 
400 includes a user interface 402, which is a graphical 
user interface (GUI) that allows the user to interface or 
communicate with browser 400. This interface provides 
for selection of various functions through menus 404 and 

30 allows for navigation through the navigation input 410. 
For example, menu 404 may allow a user to perform various 
functions, such as saving a file, opening a new window, 
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displaying a history, and entering a URL. Navigation 410 
allows for a user to navigate various pages and to select 
web sites for viewing. For example, navigation 410 may 
allow a user to see a previous page or a subsequent page 
5 relative to the present page. Navigation 410 may also 
have voice recognition capabilities. Preferences may be 
set through preferences 406. Browser 400 also contains 
text-to-speech (TTS) 408, which converts text data into 
auditory signals. 

10 Communications 412 is the mechanism with which 

browser 400 receives documents and other resources from a 
network such as the Internet. Further, communications 
412 is used to send or upload documents and resources 
onto a network. In the depicted example, communication 

15 412 uses HTTP. However, other protocols are possible. 

Documents that are received by browser 400 are processed 
by language interpretation 414, which includes an HTML 
unit 416, and a parser 418 which is capable of generating 
a parse tree associated with an electronic document, as 

20 discussed below in reference to Figure 6. Language 
interpretation 414 will process a document for 
presentation on graphical display 420. In particular, 
HTML statements are processed by HTML unit 416 for 
presentation. 

25 Graphical display 420 includes layout unit 422, 

rendering unit 424, and window management 426. These 
units are involved in presenting web pages to a user 
based on results from language interpretation 414. 

Browser 400 is presented as an example of a browser 

30 program in which the present invention may be embodied. 
Browser 400 is not meant to imply architectural 
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limitations to the present invention. Presently 
available browsers may include additional functions not 
shown or may omit functions shown in browser 400. As 
used herein, the term "browser" encompasses any software 
5 application used to view or navigate for information or 
data (e.g. something that assists a user to browse) in a 
distributed data base where the distributed database is 
typically the internet or World Wide Web. 

The present invention allows users with visual 

10 impairments , or those without a visual display, to access 
the contents of electronic documents. Users without 
visual displays might include, for example, those 
accessing the internet via cell phone while driving a 
car. The present invention is faster than the prior art 

15 in this area and provides more descriptive information to 
the user. The present invention is also applicable to 
document technologies other than HTML, such as Extensible 
Markup Language (XML) . 

Referring to Figure 5, a flowchart illustrates the 

20 general steps of the present invention. When an 

electronic document, such as a web page, is downloaded by 
browser 400, parser 418 creates a parse tree (step 501) . 
The details of the parse tree are described below in 
reference to Figure 6. The system then receives a 

25 command from the user requesting information about the 
cursor's position within the electronic document (step 
502) . This request may be made by means of any input 
device, such as for example, keyboard or voice command. 
In response to the user request, the system constructs an 

30 audible response by walking up the parse tree (step 503) . 
This audible response is then delivered to the user by 
means of a speaker (step 504) . 
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Referring now to Figure 6, a diagram illustrating an 
exemplary HTML parse tree is depicted in accordance with 
the present invention. The present invention describes 
the cursor position in an electronic document (i.e. web 
5 page) by walking the HTML parse tree, from the current 
TTS position to the root of the document. HTML, which is 
used to provide a visual structure to the page, can also 
provide a semantic structure to the page. For example, 
the HTML markup defines which ranges of text are 

10 contained under which heading, or within an item in a 

list, or within a table. Well known techniques exist for 
parsing an HTML source file into a parse tree. The 
various elements and relationships among elements are 
then apparent from the topology of the parse tree. 

15 The root of the document is the BODY 601. The body 

consists of several major sections 611-613, each tagged 
as a Heading 1 (HI) . The second HI section is titled 
"Wines" 612, which consists of three subsections 621-623 
tagged as Heading Level 2 (H2) . One of these H2 

20 subsections 621 is titled "California Wines". One of the 
paragraphs 631-633 in subsection 621 contains a table 633 
with the title "California winemakers", and so forth. A 
"Where Am I" algorithm constructs an audible position 
identification (using TTS) by walking up the parse tree 

25 600, from the tree node associated with the current POR 
to the root 601 of the document. 

Referring to Figure 7, a flowchart illustrating the 
algorithm for constructing an audible position 
identification is depicted in accordance with the present 

30 invention. The first step in the algorithm is to 

determine if cursor is presently positioned at the root 
node (step 701) . If the current node is the root node, 
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then the algorithm sets the string variable 
'resultString' to "Top of document" or "Bottom of 
document" and the algorithm terminates and 'resultString' 
contains the "Where Am I" result (step 702) . If the 
5 current node is not the root node, x resultString' is 
initialized to an empty string, and the reference 
variable A currentNode' is initialized to the parse tree 
node associated with the current POR (step 703) . 
The algorithm next constructs a string which 

10 describes the tree node which is referenced by the 
variable x currentNode' (step 704) . For example, if 
'currentNode' references the node labeled 651 in Figure 
6, the algorithm could construct a string which prefixes 
the phrase "Table cell containing: " to the actual 

15 contents of that table cell, which is "Robert Mondavi". 
For other types of HTML elements, other phrase generating 
rules could be used. For example, if 'currentNode' is 
set to the node labeled 642, a TABLE ROW node, the tree 
could be traversed to determine which row this node 

20 represents in the parse tree. For node 642, the row 

represented is the second row. Therefore, the algorithm 
could construct the string "Row 2". 

The string constructed in step 704 is then appended 
to 'resultString' , including an appropriate separator 

25 character, such as a period or semicolon (step 705) . The 
algorithm then traverses one level in the parse tree 
(step 706) . First, a reference to the parent of the node 
referenced by x currentNode' is obtained. For example, in 
Figure 6, if 'currentNode' references the node labeled 

30 642, the parentNode would be set to reference the node 
labeled 633. After the reference to the parent node is 
saved in 'parentNode' , the algorithm sets x currentNode' 
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to reference the same node as A parentNode' . The cuurent 
node reference has now moved up one level in the parse 
tree. 

Again, the algorithm checks if the node referenced 
5 by 'currentNode' is currently located at the root node 
(step 707) . If the current node is the root node, the 
algorithm ends and 'resultString' contains the "Where Am 
I" result. If the current node is not the root node, the 
algorithm returns to step 704 . 
10 Therefore, in the present example, the following 

string might be constructed: 

Current POR is: 

Table call containing: "Robert Mondavi". 
15 Row 2. 

In table titled: "California winemakers by annual 
production" . 

Under Heading 2 section titled: "California wines". 
Under Heading 1 section titled: "Wines". 

20 

The "Where Am I" algorithm would respond to a user 
request for WAI information. This request may be by 
means of any input device, such as, for example, voice 
command or keyboard. 

25 The present invention confers a number of 

advantages. It is more descriptive and intuitive than 
the prior art. It accommodates documents which are 
changed dynamically, whereas the prior art does not. It 
is very common for the content of web pages to be updated 

30 dynamically by active scripting technolgies, such as 

JavaScript. Current browser technology (i.e. MS IE 5.0+, 
Mozilla) maintains the parse tree that is associated with 
the current web page being accessed by the user, and 
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dynamically updates this tree when the web page is 
changed. 

The present invention is also faster than the prior 
art. A technique which counts every item on the page, 
5 such as is found in the prior art, requires a running 
time which is proportional to the number of items on the 
page. Web pages can change dynamically. Under prior 
art, when a WAI request is processed, every element on 
the page must be visited (and counted) to determine the 

10 index of the current POR and the total number of items on 
the page. If there are M n" items on the page, the 
running time of the algorithm will be bounded by the 
function "a*n", where "a" is some positive real number. 
Formally, this is called an 0(n) performance bound 

15 (Reference: Introduction to Algorithms, Cormen, 

Leiserson, and Rivest, ISBN 0-262-53091-0, 1997. Chapter 
2, "Growth of Functions") . The algorithm defined by the 
present invention does not need to visit every element in 
the web page to determine WAI. Instead, it visits only a 

20 very small number of nodes: each of its ancestor nodes 
from current position to the root of the tree. This 
nuinber of nodes is no larger than the height of the tree. 
As described in the cited Algorithms text, Section 13.4 
"Randomly built binary search trees", the height of a 

25 randomly built tree is a function of log(n), where "n" is 
the number of nodes in the tree (which is the same as the 
number of elements in the web page) . Therefore, the 
present invention improves running time from 0(n) to 
O(log(n)), which is an exponential improvement in speed. 

30 In practice, additional rules of thumb might be 

appropriate to determine which elements should be 
announced (and which should not) in the course of the 
walk from the current POR tree node to the root. For 
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example, elements such as SPAN (which specifies a 
non- visible formatting division) might not be announced. 
SPAN is used by HTML authors to identify a block of HTML. 
As another example, if the current position is in a table 
5 with one row and one column, the algorithm could include 
a rule of thumb that specifies that such tables are not 
announced. 

The present invention is also applicable to any XML 
or Direct Object Model (DOM) technology. HTML technology 

10 has been generalized into a more formal, and more widely 
applicable technology called Extensible Markup Language 
(XML) . Whereas HTML provides a structure only for visual 
layout of web pages, XML provides a mechanism for 
defining the structure and meaning of data in a 

15 generalized document definition language. XML is being 
applied to a wide problem domain, and is applicable 
wherever information needs to be exchanged between 
independent information systems. The most recent HTML 
definitions have redefined HTML as an instance of XML 

20 document definition technology. A DOM is the parse tree 
for an XML document. The present invention for audible 
description of the position of a document cursor within a 
HTML document is applicable to any XML document as well. 
The POR can be constructed by visiting each node in the 

25 DOM which is on the path from the current position to the 
root of the tree. At each node, the XML tag name and 
value would be announced. 

Several versions of a response might be used to 
further improve the utility of the "Where Am I" 

30 algorithm. A "verbose" response would provide all the 
information available from a complete walk up the parse 
tree, from current position to the document root. While 
this response would be the most informative, it may 
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provide more information than the user wants, 
particularly if the user queries his position several 
times from adjacent positions in the document. 

A "terse" response would provide an alternative* In 
5 this case, position information would be gathered only by 
examining the first few immediate parents of the current 
parse tree node. A threshold value might be set by the 
user, which would control how much of the parse tree 
would be examined for position information. The position 
10 algorithm would only walk up the predefined number of 
parents in the parse tree, or to the root, whichever 
comes first. 

A "delta" response provides yet another alternative. 
Under this approach, the "Where Am I" facility would 

15 maintain variables which track the parse tree location of 
the last "Where Am I" query, and the verbose response 
that would be constructed at that location. When a new 
"Where Am I" query arrives, a verbose response is 
constructed for the new location. Then the responses for 

20 the old and new locations are compared, and only those 
elements which are different are reported to the user. 
It should be noted that this is a computationally 
efficient approach, because only the two paths from 
location to root need to be compared in order to 

25 determine which nodes are different. 

The example used in describing the present invention 
has focused primarily on providing the user with an 
audible position response. However, the present 
30 invention need not be limited to an audible announcement 
of cursor position. The position could be communicated 
through a tactile feedback mechanism such as a braille 
display. The present invention might also be used in a 
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visual display that is not a graphical browser. For 
example, a text-only browser might be used, which does 
not format or arrange text within a graphical layout, but 
rather displays the text part of a web page as a 
5 character stream. 

It is important to note that while the present 
invention has been described in the context of a fully 
functioning data processing system, those of ordinary 
skill in the art will appreciate that the processes of 

10 the present invention are capable of being distributed in 
the form of a computer readable medium of instructions 
and a variety of forms and that the present invention 
applies equally regardless of the particular type of 
signal bearing media actually used to carry out the 

15 distribution. Examples of computer readable media 

include recordable-type media, such as a floppy disk, a 
hard disk drive, a RAM, CD-ROMs, DVD-ROMs, and 
transmission-type media, such as digital and analog 
communications links, wired or wireless communications 

20 links using transmission forms, such as, for example, 
radio frequency and light wave transmissions. The 
computer readable media may take the form of coded 
formats that are decoded for actual use in a particular 
data processing system. 

25 

The description of the present invention has been 
presented for purposes of illustration and description, 
and is not intended to be exhaustive or limited to the 
invention in the form disclosed. Many modifications and 
30 variations will be apparent to those of ordinary skill in 
the art. The embodiment was chosen and described in 
order to best explain the principles of the invention, 
the practical application, and to enable others of 



19 

Docket NO.AUS920000951US1 



ordinary skill in the art to understand the invention for 
various embodiments with various modifications as are 
suited to the particular use contemplated. 
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